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(57) Abstract 

In a method and a de- 
vice for partial encryption and 
orogrcssive transmission of im- 
agei.T first section of the un- 
Seflle is compressed at reduced 
polity without ce^uon. and 
a second section of the image 
fileUencrypted. Users having 

keywords can decrypt this sec- 
ond section. Tbe first section 
together with the decrypted sec- 
^ section can then be viewrf 
as a full quality image. The stor- 
age space required for storing the 
first and section together u es- 
sentially the same as the stor- 
age space requued for *onng 
the unwerypfcd full quality tm- 
aTe B y using the method and 
device as described herein stor- 
ace and bandwidth requirements 
for partially encrypted images is 
reduced. Furthermore, object 
based composition and process- 
ing of encrypted objects am ta- 
dUtated. and ROIs can be » 
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A METHOD MO * DEVICE FOR ENCRYPTION OF IMAGES 

S^TE-U- relates - a method - a device for 
encrypting images. 

BACKGROUND OF - ■ ~"». £££ fie ld which becomes 

^rr:L g - «— «- - 

S option which only shall be available to a user paying for 

Thus several methods for encrypting digital 
Tea 1 : IT "guenl ua Such methods can also he applied also 
To digit- ^data. Examples o £ encryption methods are DES, 
triple DES and the public-key RSA method. 

, • „ ™- be stored on servers and distributed over a 
Digital images can before ^ ^ can axso 

telecommunication network as ^ * ^ a 

- distributed using a ^ that sui ts 

service V?"*^™*^^ conteJtt it might be suitable to 
their business model. In this ^ 
o££ er partial access to one set of user ^ ^ ^ 

r^er intrrto pTvent all users from having full access 
to all image data. 

be offered for sale on the Internet. 
NewS P>°"^ ^ ^ to allow customers to download a 
The service provider wcm evaluation, 
version of the image with reduced quality for eva ^ 
.ournais, that want to publish an image. P^ 
are then allowed to download a full quality 

— - * -r rr; ^ :r^=r~ 

an d download bit rates, An ^mag P ^ ^ ^ ^ g . ven 

w-t to distribute images - ^ ^ ^ ^ afc a 

away or sold for a low price, c viewing tne m at full 

reduced quality, but they must ^J^J^J to use the storage 

ouality in the case the image provider wan 

^ace on the CB-ROM as efficiently as possible. 
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It is also essential that customers always oan aocess *-«- 
ZZ user friendly, standardise* software. *~J™£> ~ 
reluctant to design and support special image viewers and 
customers don't want a proliferation of viewing tools. 

Presently, image providers have to store two versions of the 
I^es stored. The full quality version is stored as an 
. „ file This means that the image first is 

L OIF The compressed file is then encrypted using a suitable 
encryption tool^and an encrypted image file is stored The user 
^ftirst decrypt this file and then access the resuming 
compressed i»age file using an Unage vowing tool Reduced 
ouality images are produced by processing the full quality ^ 
Cges in a! i,age editing program. They are stored as separate 
compressed image files. 

The problems with this solution are that at least two different 

„« of the same image need to be stored, and that both 
versions of the same J networlc in case of 

versions must als f first wants to see the free 

remote access xn the case a resolution 
low resolution image before paying for the full 



version. 



results in a ^^^TlZ 
.ersion image contains a iar* ract ^ ^ ^ 
formation. Images that_ ere^ ^ ^ 

in particular h, = provided for pr^ ^ ^ g o£ 

since 3 oumal editors ^ £or 

the image content and accepts y ^ o£ the 

printing. The reduced quality mvag 
storage space of the full quality image. 

• codinq standard JFEG 2000, 

; ^0: ^ version ,0. includes many new ^ 
£un ctionalities in comparison with other sti ^ ^ 

r= - " =; - """" 
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can select a suitable progression .ode Individual ^object, 
within images oan be accessed separately m the JPEG 2000 

and progressive transmission can be applied also to 
ob^cts in *4 2000 tbere is also snpport for independently 
decodable coding units. 

SUMMARY . , ^ 

,t is an object of the present invention to overcome the 

problems as outlined above and in particular to reduce the 

Lount of memory required for storing an image. 

shall be possible to view, and also to reduce transmrssion tune 

in a transmission scheme transmitting partially encrypted. 

images. 

Tfcis object and others are obtained by a technique 
encryption and progressive transmission of images where a first 
r=tfon of the image file can be decompressed at reduced quality 
Ttnout decryption, i.e. the first low quality rmage - not 
Icrypted. and where a second section of the rmage file rs 
encrypted . 

Thu , users having access « = ^J S ^T^ Z 
decrypt this second section. The fir y 
decrypted second section can then be vrewed^ ^ 

section together is essenc * quality image. The 

• ^ -F^-r «?torinq the unencrypted nui H^°- J 

, he oartitioned Into multiple sections where 
The image can also be P* r ""° individ ual encryption 

each section may be encrypted wrth an r ^^ted. 
me thod and Keyword, some sections^ may^ be s^ ^ 

« portent ^^'^^ages consist of a set of 
herein is that the J„ (c0) . Th is maKes it 

independently decodable coding fhe con , pres sed 

possible to perform encryption °P e « C1 °" 

domain without performing entropy 
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» reduced quality image can be produced according to several 
different main schemes, such as: 
1) Reduced resolution 

al Reduced accuracy cf the transform coefficient^ 
3, Exclusion of predefined regions of interest (ROD 

Ttes e methods can be combined so that a reduced quality i^ge is 

, vv«+-vi i-vic resolution and the accuracy 

e.g. produced by reducing both the reso-Luti 

of the transform coefficients. 

By using the method and device for storing and transmitting 
ZZ data as described herein, several advantages are obtained. 

there is no need to store two different versions of an 
I^ge if different users are to have access to different quality 
rlne one and seme image. Also, transmission times become much 
lower if the information content of the first, low 
iTge ^ta can be reused when transmitting the higher resolution 

image data- 

with reference to the accompanying drawings, in which. 

e file structure of an image. 
. Fig . x ls a general view of coded according to 

- Figs. 2a and 2b shows encryption of images c 

"^H I" fir -rt illustrating some steps carried out 
Tig^Tstlirgrrrilustrating a client server process. 
- Pig'. 5 is a view of an encryption header 

DETAILED DESCRIPTION st;nl cture of an original, 

in Fig. 1, a general view of the fi ^ ^ 

high resolution, ^/^^^ently decodable coding 
consists of a number o £ile P st „cture shown in Fig. 
sections 101, 103 and 10S. In the version o£ . Wg h 

l ' ^ ""^ir'st^d without encryption and will therefore 

resolution image, is cooeu 

be possible to decode by any receiver. 
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• j-c which combined with the 
Th* section 103, which comprises data, whicn co 
The section i , me dium resolution version of 

data of section 101, result in a encryption 
the high resolution image, is encrypted using a first encryp 

, * «nlv receivers having access to the correct 
method, and only receivers u a 

encryption key will be able to decode the data store 
section 103 . 

• which combined with the 

^ section 105, which comprises data, whicn co 
Z> of section 1.1 ana 103 results in a full resolution version 
tt the high resolution i^ge. is encrypted usmg a second 
Inception method, and only receivers having access to the 
enc^tion Key will he ahle to decode the data stored m the 
section 105. 

— «- - - rr - - - 

"Tion^ -it c^Ld ^r^ge data fro„ the section 
sectxon 103 wxxx, DecrvPtion 113 and 

rpsolution image 111. uecrypuj-w 
101 result in a „ed „ > ™£ with the i»age data 

decoding of the section x resolution image 

from the sections 101 and 103 result m a full 

115. 

^her.ore. i^entation in the ^ -^^^^ 

renge of progressive .odes can he supported. 

j n o n a coding unit is a part of 

th e bitstream that encode P^ ^ .^.^ as ^ 

snhband. In general, a coding in£ormat lon. The general 

ind ependently order is to include so 

ICC- specifies :;Ts — LtiU^order is 
^ficient to specify the subban ^ » che heade r that 

=i rr^tCi:; rr- — - - « 

«e needed for inserting explicit tags. 
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W Figs. 2a and 2b block diagrams describing how encryption can 
be implemented in tbe JPEG 2000 encoder and decoder 
respectively, are shown. 

Thns in Fig 2a a block diagram where encryption is performed 
arcs; ntroL coding in the encoder is shown. Coding unrts enter 
tn entropy Coding block 201. In the block 201 coding the codrng 
2£ J? entropy coded using some suitable entropy 
output from tbe block 201 is fed to a selector whrch selects a 
Tile encryption method for each entropy coded codrng unrt. 
some coding units can be selected to not be encrypted at all. 

m response to tbe selection made in the "lectorj*^ . the 
entropy coded coding units are encrypted rn a block 205. The 
encrypted coding units together with the not encrypted codrng 
Z™ then form a combined output data stream, whxch can be 
stored or transmitted. 

t . _ a decoder for decoding the bit stream generated by 
^ 2r in It 2a is shown. Thus, first encrypted and not 
the encoder xn Fig- 2a ^ selector 251, 

S2 odS unit, or if the received coding , un ; t „ not 
encrypted it is directly transmitted to a bloc* 255. 

, n the selection made in the selector 255 the 
in response to the seiec . nrvote& in a block 253 using a 

entropy coded ST«- 
suitable decryption algoritnm unics 
c hen fed to the block 2S| S. In tbe block « ^ decryption 

from fed directly from the selector 251 

olock 253 are entropy decoded and «*"^ ° which is £e d 

output data stream corresponding to the data 
to the entropy coding block 201 in Frg. 2a. 

^h coding ^.^^TZ^Z ^dtlock. 
Figs. 2a and 2b xs "-^J^J separately with any user 
Each coding unit can also^ »° »=™ units in che sa me image 

rrJST^S^ encryption methods. The 
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used C an further be an encryption algorithm 
SKTji 'or a method . generating — . 

n . fferent encrY ption methods can in such an embodiment have 

^specify the Encryption Method. Unit Encryption State WES) « 
a s^Tol that for each coding unit defines how it re encrypted. 

m Fig 3 a flow chart illustrating different steps carried out 

Tsteo 301 is then coded using a coding algorithm generating 
in step 30i u , tpfg 2000. in a step 

independently decodable coding units, e.g. JPEG 



303. 

~f hhe codina units of the image coded 
in 3 ; 3 S are e^d u in^ >T suitable encryption method. 

w 0 , in accordance with user preferences, in 
can be set in accoru^ hiqher order 

ctoe e to have coding units ~ = ndrn ^ ^ 

^-^".runl^hrct-rnorencrypted are merged into a 
and the coding units wni<- 

single bit stream. 

wh en transmitting an image enc ^ a cUant 

described in conjunction with Pxg. ^ ^ issue 

401 is connected to a server 03.^ ^ ^ ^ 

a request towards the serve 



405. 



r . nlies bY transmitting the coding units of the 
The server 403 replies by ^ encrypCe d 

^age which are not ««»»*• Client who now will have 
coding units can be decoded by the clie ^ 
access to a low resolution vers- or a ^ ^ ^ co 

rj;t% i ~rtiror - - - 
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client transmits a request to the server requesting such 
information, step 409. 

The server replies by sending a request to the client requesting 
the client to agree to the conditions for transmitting the 
higher resolution version of the image, step 411. If the client 
agrees via a message 413, e.g. comprising a card number or 
account number from which to bill the cost for the image, the 
server sends the encrypted coding units together with a key word 
by means of which the encrypted coding units can be decrypted, 
step 415. A secure method for key distribution should be used. 
Examples of such secure methods are described in W. stalling. 
-Data and computer Communications", p 635 -637, Prentice-Hall 
1997 fifth edition ISBN 0-13-571274-2. 

If the client already has access to the unencrypted and 
encrypted coding units, for example if he has purchased a CD-ROM 
wit^Tmages coded as described herein. The scheme as described 
in conjunction can be modified so that no image data xs 
Transmitted. Instead the client ^J^J^^ 
the server in order to have access to the key wordl . 
required to deorypt the encrypted coding units of the CD ROM. 

In the case when the method standard! it 

— — «" ^ ^ C :rstand^ does not standardise 
is advantageous if the JPEG 200Q included in the 

— "d ^i™ « Z « is merged with 
r^oo^r instead he used to specify - coding 
units are decrypted. 

I„ such an embodiment the JPEG 2000 image header contains an 
in such an , £ coding ^ 1S 

Encryption PI. MEEK ^ ^ fce appended to 

™r ,0^ rjgTneader and encryption information can 
optionally he merged into JPEG 2000 Tags. 

in Pig. S an encryption header is shown. — .-""^ 
can in such an embodiment contain the following symhols. 
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1) Encryption Mode (EM). A set of standard encryption modes are 
defined e.g. 

a) .One encryption method is used for all coding units 

b Bitplanes of less significance than bitplane X are encrypted 

c) subbands of higher resolution than Y are encrypted 

d) ROIs specified in are encrypted, etc. 

No encryption information need to included in the Tags an EM 
is defined. 

2) Encryption Mode Parameters (EMP) . Parameters (X, Y. ...» that 
are used to define the Encryption Mode are set here. 

3) Number of encryption methods used. Several encryption methods 
can be used within the same image if e.g. different user groups 
should be allowed to see different image content. 

4) One Encryption Method Descriptor (END) for each encryption 
mlthod The EMD defines any data that is needed by the 

pri ,ate key for decrypting ™ decrypt 

5) te bitstrea. «« £ °r '/^setting one 

Unit Encryption State vur. j onrrVDt ion header or 

s^ols conld either be collect. xn tbe enorypt ^ 
alternatively be distributed » the ^ ^ _ 

tags. If the DBS mfonaatxon xs kept x consi sts o£ 

cefine a header element - Encryptxor > State ESK ^ ^ 

a series of OES symbols that are listed xn 

coding units appears in the bit stress.. 

X, EF is set and tbe Encryption State is not given in the 
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header jpeq 200O Tags can be expanded to contain Unit 
^ ion State <OES, symbols. UBS defines which encrypt,- 
if any. that is need for encrypting the next codrng 

unit . 

encryption. 

The main problem is that the shape of the SOI might "veal the 
intent. If the shapes are encrypted it is. hoover drffxcult 
to show a reduced quality image since it is dxffrcult to 
interpret the coded transform coefficients. 

„, „ ™ be solved by defining a so called cloaking 
Tbis ^J 1 ^ r ^ shape o£ OM or several R 0!s are 

shape (=-shape . Thus t ^ M 

* — . - - - 

shape is a bounding box. 

rot in the JPEG 2000 bit 
* "^V/clIed ^encryption as described in 

rsr ;rrr~ :: ~ r ° — d in the TOEG 2000 

header. 

• „ ^ c- shape and the transform 
A mas* is created using the c sh aP ^ ^ 

coefficients belonging to the c P ^ fchat 

usi ng the method as deserved herein T _ 

all coefficients belonging to any of ^ ^ ^ ^ 

by the c-shape are encrypted. The tax 

protected by encryption. 

, .-h. ROls are encrypted and stored e.g. in the 

::4Tont:ir^ — ^ rr: 

~ = r^d - - 
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sbap e can be displayed as a blan* region. The original ROIe ~n 

be Loded « -e Keyword is ^ S ^h^e of TecHo! 

the coefficients belonging to the c-shape. me snap 
: onging to the c-shape is also decrypted. The "tstream ~ 
nL oe rearranged so that the c-shape is dropped- and the 
Z£l « a!ra structures are restored. H ote that thrs rs 
done in the compressed domain. 

The mask that is used for encoding a ROI is not uniquely defined 
in JPEG 2000. X masx that is sufficiently large so that the ROI 
is encoded lossless will often cover the whole lower 
"sHhat is not allowed to expand will lead to a lossy encodmg 
TJta The — helonging to different ROIs or to . ROI 
I the background can he designed to overlap. Thrs means that 

^^nts are encoded in more than one ROI- Such 
some coefficients are ei^-w^ rois 
-, „ni lead to a reduced overall compression but the ROls 
overlap wxll lead to a re accessed and decoded 

are more independent so that any ROI can be accessed 

with a good visual result. 

partial encryption ^^X^^ ^ 
d ependent of the Reconstructed fro™ the 

so that the content of a *™ ft „ ethod £or buil ding a 

content of any other ROI or gr ibed in charilaos 

r^T"^^ ^rification «odel version ,0. 

encrypted obje cts are^a crlj. ta te^ ^ ^ 

^ -Ta^S - restored in the pressed dome.. 

MoC her advantage is that "^"^t^ ^ince 
petfood at the same ti- domain Cat the 

che process takes place » the^comp ^ ^ ^ ^ 
bitstream syntax) it P £o „ ed just before 

encryption. The ^^°\ C ^J (transco der, . In this case, 
transmitting the image by a parser 
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^ hitrate which will be the case 

i£ r r P tr^ rrs:: «- — - *«~ 

transmitting it. 
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CLAIMS 

X. A method of partially encrypting image data comprising the 

finding' the image data using an encoding algorithm generating 
independently decodable coding units, 

_4.<„„ »* least one of the coding units, and 

1 ^ng cldt liL which ar. not encrypted with coding units 
which are encrypted into a combined bitstream. 

2 k method according to claim 1. characterised in that the not 
encrypted coding units correspond to a low resolution version of 
the image data. 

3 . method according to any of claims 1-2, characterised in 
Lt dl«erent coding units are encrypted using different coding 
methods. 

4 A method according to any of claims 1-3, characterised in 
Ji an encryption flag, which indicates if a ceding unit 
encrypted, is inserted in the bit stream. 

5 K method according to any of claims 1 - 1— ti- 

* Keaion of interest is encrypted, 
2 ZZZ t Shape of the region of interest is 

enclosed in a cloaking shape. 

. , ^rvtion of image data characterized 
6. A device for partial encryption of imag 

• bT: ^- „ -Khe image data according to an encoding 

- means for coding the image a ^ unitS( 

coding units which are encrypted, as 

• «.„ ^lairn 6 characterized by means for 
'J^ZZZZZ^ units a. r . corresponding 
low resolution version of the image data. 
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-means for* encrypting dift^rem: 
coding methods. 

for inserting an encryption flag, woic 
coding unit is encrypted, In the bit stream. 
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